How can spatial language be learned?

How languages are learned is one of the deepest mysteries of cognitive science. This question can be addressed from multiple perspectives. This position paper considers two of them: (1) How do people learn spatial language? (2) Given the wide range of spatial terms in language, how might we bootstrap the linguistic capabilities of intelligent systems that need spatial language to achieve wide and accurate coverage? We discuss each question in turn

How should depiction be represented and reasoned about?

Interpreting a scene requires understanding how its visual properties and context yield evidence about the spatial and conceptual properties of what it depicts. Depiction is intimately tied to spatial language, since describing a scene linguistically, or imagining a scene described in language, involves connecting linguistic and spatial knowledge. We focus here on scenes described via sketching

Proposal For a Study of Commonsense Physical Reasoning

This report describes research done at the Artificial Intelligence Laboratory of the Massachusetts Institute of Technology. Support for the laboratory's artificial intelligence research is provided in part by the Advanced Research Projects Agency of the Department of Defense under Office of Naval Research contract N00014-80-C-0505.Our common sense views of physics are the first coin in our intellectual capital; understanding precisely what they contain could be very important both for understanding ourselves and for making machines more like us. This proposal describes a domain that has been designed for studying reasoning about constrained motion and describes my theories about performing such reasoning. The issues examined include qualitative reasoning about shape and physical processes, as well as ways of using knowledge about motion other than "envisioning". Being a proposal, the treatment of these issues is necessarily cursory and incomplete.MIT Artificial Intelligence Laboratory Department of Defense Advanced Research Projects Agenc

Using a Visual Routine to Model the Computation of Positional Relationships

Modeling the encoding of visual stimuli is a complex, and often ignored, problem in computational models of visual and spatial problem solving. This paper outlines a toolkit for exploring encoding for two-dimensional visual scenes, Visual Routines for Sketches. The utility of this approach is shown by a new model for computing positional relationships, the Vector Symmetry model, that explains data from seven experiments and is more parsimonious than Regier & Carlson’s (2001) AVS model

Qualitative models for space system engineering

The objectives of this project were: (1) to investigate the implications of qualitative modeling techniques for problems arising in the monitoring, diagnosis, and design of Space Station subsystems and procedures; (2) to identify the issues involved in using qualitative models to enhance and automate engineering functions. These issues include representing operational criteria, fault models, alternate ontologies, and modeling continuous signals at a functional level of description; and (3) to develop a prototype collection of qualitative models for fluid and thermal systems commonly found in Space Station subsystems. Potential applications of qualitative modeling to space-systems engineering, including the notion of intelligent computer-aided engineering are summarized. Emphasis is given to determining which systems of the proposed Space Station provide the most leverage for study, given the current state of the art. Progress on using qualitative models, including development of the molecular collection ontology for reasoning about fluids, the interaction of qualitative and quantitative knowledge in analyzing thermodynamic cycles, and an experiment on building a natural language interface to qualitative reasoning is reported. Finally, some recommendations are made for future research

Neural Analogical Matching

Analogy is core to human cognition. It allows us to solve problems based on prior experience, it governs the way we conceptualize new information, and it even influences our visual perception. The importance of analogy to humans has made it an active area of research in the broader field of artificial intelligence, resulting in data-efficient models that learn and reason in human-like ways. While cognitive perspectives of analogy and deep learning have generally been studied independently of one another, the integration of the two lines of research is a promising step towards more robust and efficient learning techniques. As part of a growing body of research on such an integration, we introduce the Analogical Matching Network: a neural architecture that learns to produce analogies between structured, symbolic representations that are largely consistent with the principles of Structure-Mapping Theory.Comment: AAAI versio

Answering Comparison Questions in SHAKEN: A Progress Report

Abstract An important class of questions for knowledge based systems concern comparisons, such as "How is X like r." and "How are X and Y different?" This paper describes how we have used a cognitive simulation of analogical processing to answer such questions, to support domain experts in entering new knowledge. We outline techniques for case construction and summarization of comparison results that have been developed and refined based on an independent formative evaluation. In addition to these techniques, we discuss the role of the comparison system in SHAKEN, the larger system in which they are embedded, and our plans for further improvements

Making intelligent systems team players: Case studies and design issues. Volume 1: Human-computer interaction design

Initial results are reported from a multi-year, interdisciplinary effort to provide guidance and assistance for designers of intelligent systems and their user interfaces. The objective is to achieve more effective human-computer interaction (HCI) for systems with real time fault management capabilities. Intelligent fault management systems within the NASA were evaluated for insight into the design of systems with complex HCI. Preliminary results include: (1) a description of real time fault management in aerospace domains; (2) recommendations and examples for improving intelligent systems design and user interface design; (3) identification of issues requiring further research; and (4) recommendations for a development methodology integrating HCI design into intelligent system design